Central limit behavior of deterministic dynamical systems 
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We investigate the probability density of rescaled sums of iterates of deterministic dynamical 
systems, a problem relevant for many complex physical systems consisting of dependent random 
variables. A Central Limit Theorem (CLT) is only valid if the dynamical system under consideration 
is sufficiently mixing. For the fully developed logistic map and a cubic map we analytically calculate 
, the leading-order corrections to the CLT if only a finite number of iterates is added and rescaled, 

. and find excellent agreement with numerical experiments. At the critical point of period doubling 

accumulation, a CLT is not valid anymore due to strong temporal correlations between the iterates. 
Nevertheless, we provide numerical evidence that in this case the probability density converges to a 
(/-Gaussian, thus leading to a power-law generalization of the CLT. The above behavior is universal 
and independent of the order of the maximum of the map considered, i.e. relevant for large classes 
of critical dynamical systems. 
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The Central Limit Theorem (CLT) is an extremely important concept in probability theory and it also lies at the 

3 ■ heart of statistical physics [J Q . It basically says that the sum of N independent identically distributed (IID) random 

variables, rescaled with a factor 1/yN, has a Gaussian distribution in the limit N — > oo. The CLT plays a crucial 

role in explaining why many stochastic processes that are of relevance in physics, chemistry, biology, economics, etc. 

are Gaussian, provided they consist of a sum of many independent or nearly independent contributions. CLTs are 

also of fundamental importance to 'derive' statistical mechanics from first principles: If a CLT is valid for the driving 

forces in a many-body system, it is easy to proceed to the formalism of statistical mechanics via the Langevin and 

, Fokker-Planck approaches. 

' What is less known in the physics community but well-known in the mathematics community is the fact that 

VO , there are also CLTs for the iterates of deterministic dynamical systems. The iterates of a deterministic dynamical 

I ■ system can never be completely independent, since they are generated by a deterministic algorithm. However, if the 

assumption of IID is replaced by the weaker property that the dynamical system is sufficiently strongly mixing, then 

various versions of CLTs can be proved for deterministic dynamical systems 0, 13, HL S 0, B m ■ ^ should be kept in 

mind that the mixing property just means asymptotic statistical independence for large time differences. 

In this letter we investigate in detail the central limit behavior of deterministic systems. We are interested in two 

S questions that are of fundamental importance for the foundations of statistical mechanics: a) Suppose a CLT is valid 
for a deterministic dynamical system for N — > oo, what are the leading-order corrections to the CLT for large but 
'-^J ■ finite N? b) Suppose the dynamical system does not satisfy a CLT because it is not sufficiently mixing, what are 
Ch ! typical probability distributions that one obtains for these types of systems in the limit N — > oo? 

The above questions are very relevant to understand the physics of complex systems in general. First of all, any 
^ ' physical system always consists of a finite number TV of constituents rather than an infinite one. Hence finite-iV 
^ . corrections to the CLT can be potentially important for small systems. Secondly, the dynamics of critical systems 
usually exhibits strong correlations. These imply that an ordinary CLT cannot be valid. In such cases it is important 
to know what type of distributions replace the usual Gaussian limit distributions. 



In full generality, the above two problems are very difficult to deal with. Hence there is the need to start with simple 
model systems where some statements can be rigorously proved. Our main example in the following is the logistic map. 
For the fully developed chaotic state of this map, a CLT has been proved [3|. We will explicitly calculate leading-order 
corrections to the Gaussian limit case if a finite number N of iterates is added and rescaled with 1 / \/~N. Moreover, 
we will provide evidence that at the critical point of period doubling accumulation, where a CLT is not valid due 
to strong correlations between the iterates, a suitably rescaled sum of iterates appears to generate distributions with 
power law tails, which are well approximated by q-Gaussians. These distributions are known to play an important role 
in generalized versions of statistical mechanics HH, H3 ■ Although our results are derived for the special example 
of the logistic map, we will show that they are universal, i.e., applicable to entire classes of deterministic dynamical 
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FIG. 1: (Color online) Probability density of rescaled sums of iterates of the logistic map with a = 2 as given by eq. l[8). 
TV = 2 x 10 6 and TV = 100. The number of initial values contributing to the histogram is n;„i = 2 x 10 6 , respectively n; n i = 10 7 . 
The solid lines correspond to eq. @. 



systems. 

To start with, let us consider a e?-dimensional mapping of the form 

Xi+i = T(xi) (1) 

on some <i-dimensional phase space X. If T is sufficiently strongly mixing (see [1, H, d, for technical details), one 
can prove the existence of a CLT. This means the probability distribution of 



y-=-kT,f(^ ( 2 ) 

* i— 1 

becomes Gaussian for N — > oo, regarding the initial value X\ as a random variable. Here / : lZ d — ► 7?. fc is a 
suitable smooth function with vanishing average which projects from the e?-dimensional phase space to a fc-dimensional 
subspace. If d = k = 1, the variance a 2 of this Gaussian is given by [8[ 

oo 

a 2 = (f(x Q ) 2 ) +2j2(f(^)f(xi)). (3) 

i=i 

Here (• • • ) denotes an expectation formed with the natural invariant density of the map T. 
As an example to illustrate these general results, let us consider the logistic map 

x i+ i = T(xi) = 1 - ax 2 (4) 

on the interval X = [—1, 1]. For a = 2 the system is (semi)conjugated to a Bernoulli shift and strongly mixing. The 
natural invariant density is 

Px(x) = — , (5) 
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Ergodic averages of arbitrary observables A are given by 



(A(x)) = / p(x)A(x)dx. (6) 



i 



The average (x) vanishes. For the correlation function one has 
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Due to the strong mixing property, the conditions for the validity of a CLT are satisfied for a 
distribution of the quantity 



2. This means the 
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(8) 



becomes Gaussian for N — > oo, regarding the initial value x\ as a random variable with a smooth probability 
distribution. For the variance of this Gaussian we obtain from eq. ([3]) and ||7J) the value o 1 = \ (choosing f(x) = x). 
The above CLT result is highly nontrivial, since there are complicated higher-order correlations between the iterates 
of the logistic map for a — 2 (see [l3[ for details). This means the ordinary CLT, which is only valid for independent 
Xi cannot be directly applied, an extension of the CLT for mixing systems is necessary 

For physical and practical applications, the number N is always finite, hence it is important to know what the finite- 
iV corrections are for a given dynamical system. This problem can be solved for our example, the map T(x) = 1 — 2a; 2 , 
by applying the general graph-theoretical methods developed in [l3], [l4| . Our final result is that for finite but large 
N the probability density of y is given by 



Py(v) = -j=z 

\/7T 
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(9) 



This result is in excellent agreement with numerical experiments (Fig. 1). 

We should mention at this point that the finite-iV corrections are non-universal, i.e. different mappings have 
different finite- N corrections. For example, by applying the techniques of [HI, [3| to the cubic map 



Cj+i = 4x; - 3xi 



(10) 



which has the same invariant density (JSJ) as the logistic map with a = 2 but different higher-order correlations, we 
obtain in leading order 



Py(y) = ~r e ~ 

\/7T 



1 ( 1 4 1 2 1 

1 + — —y 4 - -y 2 + — 
N V12 4 y 16 



(11) 



Note that in this case the leading-order corrections are of order 1 /N, rather than of order 1/ y N. Again our analytical 
result is in good agreement with the numerics, see Fig. 2. 

Apparently the finite- TV corrections to the asymptotic Gaussian behavior of dynamical systems satisfying a CLT 
are non-universal and can be used to obtain more information on the underlying deterministic dynamics. This is 
certainly important from a general physical point of view if the dynamics underlying a CLT is a priori unknown. 
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FIG. 3: (Color online) Probability density of rescaled sums of iterates of the logistic map as given by eq. ([8| for a — 1.7, 1.8, 1.9 
and N = 2 x 10 6 , n ini = 10 6 . The solid lines show Gaussians e~ y ^ 2a ' /y/2ircr 2 with variance parameter a 1 determined from 
eq. ©. 

We may also look at distributions of the variable y obtained for 'typical' parameter values in the chaotic regime 
of the logistic map, such as a — 1.7, 1.8, 1.9. A CLT has not been rigorously proved in this case, but nevertheless we 
again observe Gaussian limit behavior. This is shown in Fig. 3. It is a well-known fact that for a < 2 the average (x) 
does not vanish anymore. The Gaussians observed in Fig. 3 have smaller variance a 2 as compared to the case a = 2. 
This can be understood in a quantitative way from eq. ([31) ■ The fits in Fig. 3 show Gaussians with variance parameter 
a 2 directly determined from eq. ([3]) using f(x) — x — (x) (the averages (...) are calculated as time averages). Note 
that for a = 1.7, 1.8, 1.9 the correlation function is not (^-correlated anymore. 

Next, let us investigate the behavior of deterministic dynamical systems where the conditions for a CLT are not 
satisfied. As a particularly interesting example, we choose the logistic map at the accumulation point of period 
doublings (i.e., at the edge of chaos). The corresponding parameter value is denoted by a c . For a = a c the logistic 
map is not sufficiently strongly mixing and a CLT is not valid. Still one can ask the question if there is a universal 
limit distribution for suitably rescaled sums of iterates. We investigated this question numerically and looked at 
rescaled sums of the form 



Eq. Q12[) is a generalization of eq. ([S]) with a more general rescaling exponent 7. The notation (• • • ) means an average 

over a large number N of iterations and a large number of randomly chosen initial values x[^ . Numerically we 
calculate 



Due to the fact that the system is not necessarily ergodic anymore, the average over initial conditions is an important 
ingredient. 

In our numerical experiment, a large number of initial values x\ were randomly chosen and the corresponding values 
of the sum Y were plotted in a histogram. We then looked for a suitable rescaling exponent 7 where we have data 
collapse, i.e., the same shape of the probability distributions p y (y) of y if N is increased. Numerically we observe 
that, at a — a c , this value is given by 7 — 1.5. The density of y is not given by a Gaussian, as one would expect if a 
CLT is valid, but well fitted by a q-Gaussian, i.e. a distribution of the form 
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FIG. 4: (Color online) Probability density of the quantity y/a at the critical point a c for z = 2, TV = 2 14 and /V = 2 lj . 

where g and /3 are suitable parameters. We observe q = 1.75 ± 0.03 (see Fig. 4). The rescaling factor TV 7 in eq. (JT3J) 
can be absorbed by simply calculating the variance a 2 of the unrescaled sum y :— YIj—i (xj — (x)) for a given N and 
then plotting a histogram of y/a. 

Interesting enough, the values of q and 7 that we observe in our numerical experiments are independent of the order 
of the maximum of the map considered. Indeed, if instead of the logistic map Q we iterate the more general map 

X1+1 = 1 - a\xi\ z , (15) 

then at the critical point a c {z) of period doubling accumulation the results are basically unchanged (see Fig. 5). 

Since at the critical point the dynamics of many different maps converges to a dynamics given by the universal 
Feigenbaum fixed point function [15| . our results for the asymptotic probability distribution of Y are universal: 
Entire classes of critical quadratic maps will generate the same g-Gaussian limit distribution. Our result is even more 
universal since there seems to be no dependence on the order z of the maximum of the map. Thus we expect the 
g-Gaussian limit distribution with q w 1.75 to be relevant for many different dynamical systems at the critical point. 

The independence of z has also been established in a different context: In [16[ it is shown that, for all values of z, 
the relevant fixed point map describing period doubling bifurcations (tangent bifurcations) is a specific g-exponcntial 
with q = 3 (q = 2). 

The generalized central limit behavior of critical dynamical systems observed in this paper may be of relevance for 
more general classes of critical systems in physics as well. For example, Caruso et al. [l7| observe that the probability 
distribution of energy differences of subsequent earthquakes in the World Catalog and in Northern California is well 
fitted by a g-Gaussian with q w 1.75. Their model for this is based on self-organized criticality and the OFC model. 
We note that g-Gaussians with g « 1.75 arise naturally if the corresponding random variable consist of a sum of 
strongly correlated contributions as generated by critical dynamical systems. A somewhat similar result has also 
been recently observed for Brazilian financial data: A g-Gaussian with g ~ 1.75 fits histograms of stock market index 
changes for a considerable range of time delays (see Fig. 6 of [Hj]). 

To conclude, in this paper we have explicitly calculated finite- A-corrcctions to the CLT for some examples of 
strongly mixing dynamical systems. For critical systems at the edge of chaos, where a CLT is not valid anymore due 
to strong correlations, we have shown that the relevant limit distributions appear to be g-Gaussians with g w 1.75. 
This result is universal and independent of the order of the maximum of the map under consideration. Our results 
represent a kind of power-law generalization of the CLT, which is relevant for entire classes of dynamical systems. 
An analytical study of the present results at the edge of chaos and of more general critical dynamical systems would 
be very welcome. This might, in particular, enlighten the deep reasons for the frequent occurrence of g-Gaussians in 
natural, artificial and social complex systems. 

This work has been supported by TUBITAK (Turkish Agency) under the Research Project number 104T148. C.B. 
acknowledges financial support by EPSRC. C.T. acknowledges partial financial support from Pronex, CNPq and 
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FIG. 5: (Color online) Probability density of the quantity y/a at the critical point a c for z = 1.75, 2, 3. 



Faperj (Brazilian Agencies). 



[1 
[2 
[3 

K 

[5 

[-: 

[8 
[9 
[10 

[11 
[12 

[13 
[14 
[15 
[16 
[17 
[18 



N.G. van Kampen, Stochastic Processes in Physics and Chemistry, North Holland, Amsterdam (1981) 
A.Ya. Khinchin, Mathematical Foundations of Statistical Mechanics, Dover, New York (1949) 
P. Billingsley, Convergence of Probability Measures, Wiley, New York (1968) 
M. Kac, Ann. Math. 47, 33 (1946) 

N.I. Chernov, Prob. Theor. Rel. Fields 101, 321 (1995) 

F. Hofbauer and G. Keller, Math. Z. 180, 119 (1982) 

C. Beck, Physica A 169, 324 (1990) 

C. Beck and G. Roepstorff, Physica A 145, 1 (1987) 

M.C. Mackey and M. Tyran-Kaminska, Phys. Rep. 422, 167 (2006) 

C. Tsallis, J. Stat. Phys. 52, 479 (1988) 

C. Tsallis, Physica A 365, 7 (2006) 

S. Umarov, C. Tsallis, and S. Steinberg, cond- mat/0603593 see also S. Umarov, C. Tsallis, M. Gell-Mann and S. Steinberg, 
|cond-mat/0606038| and |cond-mat /0606040| 
C. Beck, Nonlinearity 4, 1131 (1991) 
A. Hilgers and C. Beck, Physica D 156, 1 (2001) 
M.J. Feigenbaum, J. Stat. Phys. 46, 919 (1987) 
A. Robledo, Physica D 193, 153 (2004). 

F. Caruso, A. Pluchino, V. Latora, S. Vinciguerra, and A. Rapisarda, cond-mat/0606118 
A.A.G. Cortines and R. Riera, Physica A 377, 181(2007). 



